Novel Coumarins Derivatives for A. baumannii Lung Infection Developed by High-Throughput Screening and Reinforcement Learning

With the increasing resistance of Acinetobacter baumannii (A. baumannii) to antibiotics, researchers have turned their attention to the development of new antimicrobial agents. Among them, coumarin-based heterocycles have attracted much attention due to their unique biological activities, especially in the field of antibacterial infection. In this study, a series of coumarin derivatives were synthesized and screened for their bactericidal activities (Ren et al. 2018; Salehian et al. 2021). The inhibitory activities of these compounds on bacterial strains were evaluated, and the related mechanism of the new compounds was explored. Firstly, the MIC values and bacterial growth curves were measured after compound treatment to evaluate the antibacterial activity in vitro. Then, the in vivo antibacterial activities of the new compounds were assessed on A. baumannii-infected mice by determining the mice survival rates, counting bacterial CFU numbers, measuring inflammatory cytokine levels, and histopathology analysis. In addition, the ROS levels in the bacterial cells were measured with DCFH-DA detection kit. Furthermore, the potential target and detailed mechanism of the new compounds during infection disease therapy were predicted and evidenced with molecular docking. After that, ADMET characteristic prediction was completed, and novel, synthesizable, drug-effective molecules were optimized with reinforcement learning study based on the probed compound as a training template. The interaction between the selected structures and target proteins was further evidenced with molecular docking. This series of innovative studies provides important theoretical and experimental data for the development of new anti-A. baumannii infection drugs.


Introduction
Acinetobacter Bowman (A. baumannii) is an opportunistic gram-negative bacterium with highly resistant to conventional prescription antibiotics and has excellent viability under various environmental conditions (Ayoub Moubareck et al. 2020;Jean et al. 2022).A. baumannii is one of the most important clinical pathogens with increasing isolation rate, infection rate and drug resistance, which has become a challenge in the global anti-infection field (Mea et al. 2021;Oliveira et al. 2020).A. baumannii now accounts for nearly 12% of all hospital-acquired infections worldwide and up to one-third of hospital-acquired infections in Asian countries (Gandra et al. 2020).It is also the most important "Superbacterium" in our country and one of the most important pathogens of nosocomial infection.But there is no vaccine to prevent A. baumannii infection in the world, we need develop new weapon for the A. baumannii infection therapy with excellent pharmacological effect and low toxicity.
Studies indicated that designing novel anti-bacterial compound with new structure and mechanism may be a good choice for overcome antibiotic resistance in A. baumannii.Coumarin, also known as bisfuran cyclooxaphthalone, is a kind of lactone compound widely present in nature, mostly in Rutaceae and Umbelliferae, which showed different biological properties, such as antimicrobial, antibacterial, antifungal, antioxidant, antitumor, anticancer, antiviral, anti-inflammatory, and so on (Bhattarai et al. 2021;Feng et al. 2020;G et al. 2022).In our previous research, a coumarin derivative DCH has been proved with excellent antibacteria effect through binding with the ArgR regulator in MRSA (Qu et al. 2020).Thus, more novel structures were designed for the anti-A.baumannii evaluation in this study.The computer reinforcement learning methods were popular in the novel compounds development, which could predicate more effective candidate compounds via the known structures, and give a preliminary forecast about the biological activity of synthesized compounds.Thus, in this research, after the compound activity screening, target docking and ADMET predication, more novel derivatives were designed with computer for further anti-A.baumannii evaluation.
In this present research, coumarin derivatives with novel structure were designed and synthesized.Molecule and supramolecular structures of the compounds were identified and then the biological activities were evaluated.The MIC values showed the coumarin derivatives (1-5) have stronger anti-bacterial activity than the derivatives (6-10).Among these compounds, compound 1 (named as S1032 in the biological experiments) exhibited most excellent inhibitory activity on the A. baumannii strain.Additional, the survival rate of the A. baumannii infected mice was also up-regulated by the S1032 dose dependently, and the A. baumannii CFU numbers in lung tissue was downregulated as well, suggesting the protective activity of the S1032 in vivo.Besides, the S1032 could also reduce the releasing of inflammatory cytokines and tissue damage of the mice.For the mechanism exploration, docking were carried out and he OmpA, BaeSR, AdeSR, AroA and CsuE proteins were predicated could formation covalent binding with S1032, which explained the excellent inhibitory activity on the multiplication, growth and biofilm formation of A. baumannii.All the results above provided the basis and new strategy for developing new anti-A.baumannii infection agents.Moreover, based on our previous study of using reinforcement learning technic for generating biologically effective drug molecules (Li et al. 2022), S1032 has been used as training template for conducting the reinforcement learning study, with the aim to optimize potential drug molecules that may also interfere with multiplication, growth and biofilm formation of A. baumannii, which could be the following research direction.

X-ray Crystallography
SuperNova diffractometer was utilized in acquiring XRD patterns.CrysAlisPro was employed to analyze intense data and converted the data to HKL files.SHELXS in the light of direct mean and SHELXL-2014 software based on leastsquares strategy were employed respectively for the synthesis and refinement of original architectural modes.After the addition of non-H atoms, the anisotropic parameters could be mixed.Eventually, the entire H atoms could be fixed on the C atoms that bridged with AFIX commands in geometry.The as-prepared compounds' refinement details and crystallography parameters are displayed in Table 1.

Strains and Animals
Methicillin-resistant Staphylococcus aureus N315 (MRSA N315); Staphylococcus aureus ATCC 29,213 (S. aureus ATCC 29,213); Pseudomonas aeruginosa (P.aeruginosa); Klebsiella pneumonia (K.pneumoniae); Acinetobacter baumannii (A.baumannii) and Escherichia coli (E.coli) were purchased from the American Type Culture Collection (ATCC).All the clinical A. baumannii strains were provided by the Zibo Prevention and Treatment Hospital for Occupation Diseases (Zibo, China).The bacteria were cultured on Nutrient agar plates (Sigma-Aldrich, USA) at 37℃ in an incubator and then transferred into Nutrient broth for strain replication at the condition of 220 rpm, 37℃.
BALB/c mice (5-6weeks, 20-22 g) were used in this research, which were purchased form the Animal Research Center of the Fourth Military Medical University (Xi'an, China).All the mice were maintained at a specific pathogenfree (SPF) environment of 20-25℃, combined with a 12hour light/dark schedule and free standard laboratory mouse chow and water supply.All the preformation in mice were approved by the Institutional Animal Care and Use Committee (IACUC) of the Fourth Military Medical University, refluxed for 2-3 h and then cooled to room temperature.The solid was filtered off and then recrystallized from ethanol to give compounds 6-10.

Mice Lung Infection Model
BALB/c mice (5-6weeks, 20-22 g) used in this present study were divided randomly into different groups: the negative control group (n = 7), positive control group (receive antibiotic treatment, n = 7) and S1032 treatment groups (1, 2 and 5 mg/kg, n = 7).Then the mice were challenged with 5 × 10 9 CFU A. baumannii in 20 µl Nutrient broth via nasal drops.After bacterial infection, S1032 (1, 2 and 5 mg/kg) and Ofloxacin (5 mg/kg) was given for 7 consecutive days, with saline used as negative control.The survival rates of the mice in each group were monitored since infection, and the cumulative percentage survival was plotted (Tansho-Nagakawa et al. 2021).

Therapeutic Activity Evaluation
To evaluate the therapeutic activity of the synthesized S1032, the A. baumannii bacterial CFU numbers in lung tissue was determined in this research.Briefly, after the construction of lung infection mice model, S1032 was given for treatment with indicated concentrations (1, 2 and 5 mg/ kg) for three consecutive days.7 days after infection, the animals were euthanized for the infected tissue collection.The tissue samples were grinded, diluted and dripped onto Nutrient agar plates for 24 h cultivation at 37℃ and 5%CO 2 condition.The numbers of bacterial colony were counted and recorded.This experiment was repeated at least three times, and the results were presented as mean ± SD.
After the collection of infected mice lung tissue, which were then fixed in 10% neutral buffered formalin for 24 h.Then the tissue samples were dehydrated and processed into paraffin sections totally according to the standard procedure.The paraffin sections were then stained with hematoxylin and eosin (H&E) staining for histopathology analysis, and the microscope was used for observation of tissues morphologies.and conducted totally under the guidance of the health guidelines for the use of laboratory animals.

MIC Determination
The minimum inhibitory concentration (MIC) values of the synthesized compounds were determined with broth microdilution technique for the anti-bacterial activity evaluation.This preformation was conducted strictly under the guidance of the instructions with some modifications (Kowalska-Krochmal and Dudek-Wicher 2021).In brief, the bacterial strains were cultured in Nutrient broth and seeded into the microtiter plates at a final concentration of 1 × 10 8 CFU/ml overnight.Then, the synthesized compounds and reference antibiotic in 100 µl culture medium was added into the wells with serial concentrations (2-256 µg/mL) for another 24 h.The OD 600 values of each well were measured, and the MIC values of the compounds were regarded as the lowest concentrations completely inhibit the bacterial growth.

A. baumannii Growth Curves
The inhibitory activity of the synthesized S1032 on A. baumannii growth was evaluated in this experiment under the guidance of the following descriptions.The A. baumannii strain was collected and cultured in Nutrient broth at the condition of 220 rpm, 37 °C.Then the bacterial cells were planted into microtiter plates (1 × 10 8 CFU/ml) with S1032 added for treatment, the same concentration of Ofloxacin and Gentamicin were used as control.The plates were placed in an automated Bioscreen C system in the automatic bacterial growth curve analyzer (Bioscreen, Finland) at 37 °C, and the absorbances of all the wells were determined every hour at 600 nm (Rivani et al. 2022).

qPCR Assay
The qPCR was performed in this research to measure the relative expression of the genes related with bacterial biofilm formation.In brief, the A. baumannii bacterial cells the dark, the bacteria cells were harvested, washed at least three times to remove the extra fluorescence probe.Fluorescence intensity of each sample was detected at an excitation wavelength of 484 nm and an emission wavelength of 525 nm (Wang et al. 2022).This research was repeated at least three times.

Cytotoxicity Evaluation
Cell Counting Kit-8 (CCK-8) assay was conducted in this research to evaluate the cytotoxicity of active S1032 against human umbilical vein endothelial cells (HUVEC) and human embryonic kidney (Hek) 293T cells.This research was conducted under the guidance of manufactures' instruction.The HUVEC and 293T cells were collected and seeded into the 96 well plates at the destiny of 5000 cell/well.After the cell got the 70-80% confluence, the S1032 was added for 48 h incubation with serial different concentrations (2.5, 5, 10, 20, 40, 80, 100 and 200 µM).After that, the culture medium was discarded, and the cells were washed with PBS solution.Fresh culture medium containing 10 µL CCK-8 reagents was added into the well for 4 h incubation.Then, the absorbance of each well was measured at 490 mm.This preformation was conducted at least three times, and the results were presented as mean ± SD.

ADMET Predication Online
The ADMET parameter of the S1032 was predicated using SWISS ADME online tool (http://www.swissadme.ch/)(Daina et al. 2017).The SMILES of the compound were produced and was lodged into the SWISS ADME website, and the physicochemical properties, lipophilicity, water solubility, pharmacokinetics, druglikeness and medicinal chemistry was predicated.

Molecular Docking
Four structures were considered as the target proteins for the docking studies, their structures were retrieved from Protein Data Bank (PDB) and the PDB IDs were 3TD3 (Park et al. 2012), 4JAS (Podgornaia et al. 2013), 5BUF (Sutton et al. 2016) and 6FJY (Pakharukova et al. 2018).The active sites of S1032 and predicated target proteins were measured with molecular docking study via AutoSite (v1.1) tool software (Ravindranath and Sanner 2016).Firstly, the 3D structures of target proteins in PDB format were downloaded from RCSB Protein Data Bank.Then, the ligand structure (S1032) was prepared by Avogadro (v1.2) (Hanwell et al. 2012), an energy minimization was performed through steepest descent algorithm adopting general Amber force field (GAFF) (Wang et al. 2004).After obtaining structures

Biofilm Formation Assay
To evaluate the inhibitory activity of the S1032 compound on bacterial biofilm formation, the crystal violet staining assay was performed in this research.All the conduction was finished strictly under the guidance with only a little modification (Khan et al. 2022).In short, A. baumannii strain were seeded in 96 well plates and cultured in the incubator at the condition of 37℃ for 24 h.After the bacterial biofilm formation, 0.1% crystal violet (CV) (Sigma) solution was added into wells for staining at 37 °C for 10 min.After that, PBS was used to wash the unattached CV and 95% ethanol was added to detainee the stained biofilm cells.The solution absorption was measured at 600 nm, each group has independent replicates, and this experiment was repeated at least three times.

Scanning Electron Microscope for Biofilm Observation
The bacterial culture solution was diluted to 1 × 10 8 CFU/ ml.500 µl of the diluted bacterial solution was added to the 24-well cell culture plate wells that contained sterilized coverslips.The plate was incubated at 37℃ in a incubator for 36 h.The coverslips with adhered bacteria were gently washed with sterile PBS to remove any unattached freefloating bacteria.Then, 2.5% (v/v) glutaraldehyde solution was added, and the samples were fixed overnight at 4℃.The fixative was aspirated, and the samples were washed three times with sterile PBS, each time for 10 min.After washing with sterile water several times, the samples were dehydrated with 30%, 50%, 70%, and 90% ethanol for 15 min each, and finally dehydrated twice with 100% ethanol, each time for 15 min.The samples were then placed in a vacuum freeze-drying machine and freeze-dried for 2-3 h.The dried samples were taken out, attached to a sample holder with conductive adhesive, and observed under a scanning electron microscope (Gould et al. 2022).

Intracellular ROS Determination
The A. baumannii bacterial cells were grown in Nutrient broth at 37 ℃ to exponential phase and seeded into the microtiter plates at the final destiny of 5 × 10 7 CFU/ml overnight.Then, the Nutrient broth containing the active S1032 with the final concentrations of 0.25, 0.5 and 1 µg/m was added into the bacterial wells for 2 hours incubation.After that, the A. baumannii bacterial cells were collected, washed, centrifuged and re-suspended with PBS solution.

Reinforcement Learning Studies
The For these three qualification measurements, the Smile code of the molecular structure has been used as input, consequently, the 3-dimensional structure is effected using Open Babel.
For each of the ligand (S1032) -protein (3TD3, 4JAS, 5BUF and 6FJY) combination, the maximum number of allowed modifications (actions) is set to 20, during the modification, only C, N, O atoms are allowed, and up to 10,000 molecule structures are evaluated.After the reinforcement learning study, four molecules that are showing excellent binding affinity energies, SA and QED scores are selected, and a further molecular docking simulation has been performed using the same procedure described in the above Molecular Docking section.

Statistical Analysis
All the biological experiments in this research were conducted in triplicate and the results were presented as the mean ± standard deviation (SD).SPSS 20.0 statistical software (SPSSInc.,Chicago, IL, USA) was recommended for the analysis.Two-tailed Student's t-test was used to analyze the difference between two groups, and the one-way ANOVA method was carried out for the analysis among more than three groups.Statistical significance was considered as P < 0.05.
for both ligand and proteins, we used AutoDockTools (v1.5.7 patch 1) to prepare the docking simulations, and the docking studies were conducted using AutoDock4 (v4.2.6) (Morris et al. 2009).For the docking simulation, 50 potential docking poses are evaluated using the Lamarckian genetic algorithm (LGA).The binding affinity of the complexes was recorded with a unit of kcal/mol.The protein-ligand interactions were analyzed using PLIP (Adasme et al. 2021).

Reinforcement Learning Studies
The reinforcement learning approach that was implemented and performed in the current study is based on the widely used molecule deep Q-networks (MolDQN) (Zhou et al. 2019).During the reinforcement learning process, a known molecule that has been proved to have excellent bioactivities depending on demands and requirements of the study (in the current work, the desired molecule is the inhibitor of A. baumannii) is used as the training template (Almihyawi et al. 2022;Abdelaziz et al. 2022).Then, multiple actions are allowed to modify the template and generate novel structure which is expected to have similar or even better bioactivity than the given template, the allowed actions are atom addition, bond addition, bond removal and un-modification.After a certain number of actions has been performed.Three qualification characteristics are determined upon the optimized structure, these qualification characteristics are: (i).binding affinity energy between the optimized molecule and the protein; (ii).synthetic accessibility (SA) score; (iii) quantitative estimate of drug-likeness (QED) score.Explicitly, the binding affinity energy is evaluated by QuickVina 2 (Alhossary et al. 2015), which has been proven to have both accuracy and efficiency as AutoDock 4, as has been mentioned in the above docking study, the gym-molecule library has been employed to calculate the SA score, and the open source library rdkit (https://www.rdkit.org/)has been utilized to estimate the QED score.For these three qualification measurements, the Smile code of the molecular structure has been used as input, consequently, the 3-dimensional structure is effected using Open Babel.
For each of the ligand (S1032) -protein (3TD3, 4JAS, 5BUF and 6FJY) combination, the maximum number of allowed modifications (actions) is set to 20, during the modification, only C, N, O atoms are allowed, and up to 10,000 molecule structures are evaluated.After the reinforcement learning study, four molecules that are showing excellent binding affinity energies, SA and QED scores are selected, and a further molecular docking simulation has been performed using the same procedure described in the above Molecular Docking section.the C4-C5 bond which give a three-ring structure.There exists one cyano (C1-N1) and one amino (N2H2) groups on the six-membered via the bonds of C1-C2 and N2-C3.In addition, the benzene ring (C14-C16, C18, C20, C21) connect the six-membered ring (C2-C6 and O1) via the bond of C14-C16.Also, there exist two methyl groups (C19H3 and C17H3) connect the benzene ring via the bond of C18-C19 and C16-C17.And further there exist one ethanol molecule in the structure of 6.In addition, the adjacent molecules were further connected to produce a dense packing structure (Fig. 1e-f).

Potent Activity of Synthesized Compounds Against Bacteria In Vitro
Two series of chemical compounds, coumarin derivatives (1-5) and derivatives (6-10) were designed and synthesized in this research to screen possible antibacterial small-molecular chemical compounds.The anti-bacterial activities of these new compounds were evaluated via MIC determination.As the results showed in Table 1, we can see the anti-bacterial activity of the coumarin derivatives (1-5) was much stronger than that of the derivatives (6-10).The coumarin derivatives 1 (named as S1032) exhibited most excellent biological effect on Gram negative bacteria, especially against A. baumannii with minimal inhibitory concentration (MIC) of 0.5 µg/ml.The S1032 also showed inhibitory effect on other Gram negative bacteria, such as P. aeruginosa, K. pneumoniae, A. baumannii and E. coli, with MIC of 2-4 µg/ml, respectively.Next, more clinical A. baumannii strains (ZB 25,327) were collected then the MIC of the S1032 against these strains were measured and showed in Table 3.Compared with the positive control antibiotics, Ofloxacin and Gentamicin, S1032 showed much more outstanding inhibitory activity.This result indicated the clinical A. baumannii strains are resistant to Ofloxacin

Ethics Statement
All the in vivo experiments were approved by the Committee of Animal Ethics of the Fourth Military Medical University (Xi'an, China).All the preformation was strictly in accordance with the manufactures' instructions with some modifications.

Molecular Structure of Novel Compounds
The crystal structure of 1 was identified by the single-crystal diffraction, data analysis reveal that 1 crystallizes in the monoclinic crystal system with the P2 1 /n space group.The molecular structural unit of 1 is displayed in Fig. 1a.The skeleton of 1 consists of three parts: two 4-hydroxy-2 H-chromen-2-one molecules [(C2-C10, O1-O3) and (C11-C19, O4-O6)]-A and one 4-hydroxy-3-methoxybenzaldehyde (C1, C20-C26, O7 and O8)-B.During the synthesis procedure, two A molecules and one B molecule were bind via the sp 3 C1 atom of the B, giving the molecule structure of 1.And further the adjacent molecules were further packed via the intermolecular interaction to give a supramolecule network (Fig. 1b-c).
The x-ray single-crystal diffraction measurements were used to explore the micro-structure of 6, revealing that 6 shows the triclinic crystal system with P-1 space group.As shown in Fig. 1d, the molecule structure of 6 consist of two benzene ring and two six-membered rings.The benzene ring (C8-C13) connects the six-membered ring (C4, C5, C-C9 and O2) via the sharing of the bond C8-C9, and there exists O3 atom one the six-membered ring via the double bond of C7 = O3.The two six-membered rings (C4, C5, C-C9 and O2) and (C2-C6 and O1) were connected via was up-regulated significantly.The survival rate was 85.7% under 5 mg/kg S1032 treatment (Fig. 3a).Furthermore, the A. baumannii CFU numbers in the infected ling tissue were also counted and the date suggested that the bacterial load in the model group was much higher than that of the control group.There was a significantly difference between these groups, with P < 0.005.Under the treatment of the S1032, the bacterial load in the lung was reduced obviously.The inhibition of the S1032 showed a dose dependent relationship, which is much stronger than the Ofloxacin at the concentration of 5 mg/kg (Fig. 3b).Hematoxylin and eosin (H&E) staining reveals that A. baumannii infection triggers a robust inflammatory response in the lungs, characterized by a substantial infiltration of inflammatory cells.Following the infection, lung tissue undergoes necrosis, which is evident through the deeper staining and the distinctive dark red hue, contrasting sharply with the normal surrounding tissue.Notably, infected tissue exhibits heightened congestion, clearly distinguishable from the uninfected control group.Strikingly, treatment with S1032 mitigates the inflammatory damage, necrosis, and local congestion in the lung tissue of mice.The salutary effect of S1032 is presumably achieved by impeding bacterial growth, thereby reducing tissue injury and Gentamicin, but sensitive to S1032 compound.Besides, the influence of the S1032 on the growth curves of clinic s A. baumannii strains was further measured.The results in Fig. 2 suggested the S1032 significantly reduced the growth curves of these strains, and the inhibition of S1032 against MDR-AB clinic strains was stronger than Ofloxacin and Gentamicin.This result was consistence with the MIC results in Table 4.

Protective Activity of S1032 on A. baumannii Infected Mice
As the excellent inhibitory activity of the S1032 on MDR-AB clinic strains in vitro, ZB 25,321 was further used for bacterial infection mice model construction and in vivo therapeutic effect evaluation.S1032 was injected for treatment at 1, 2 and 5 mg/kg, Ofloxacin was used as control drugs.The results in Fig. 3a indicated that all the mice infected with the A. baumannii in the control group died within 3 days.The mice in the Ofloxacin treated groups also died within 3 days.While, after intraperitoneal administrated with the S1032 at the concentration of 1, 2 and 5 mg/kg, the death time of the mice was delayed, and the survival rate of the animal Compounds ZB 25,321 ZB 25,322 ZB 25,323 ZB 25,324 ZB 25,325 ZB 25,326 ZB 25,327 S1032 0.5 0.5 0.5 0.5 0.5 0.5 0. results in biofilm formation suggested that the S1032 also showed excellent inhibitory effect on the biofilm formation genes expression with the sub-MIC concentrations dose dependently, and the scanning electron microscope (SEM) images also proved the inhibitory activity of the new S1032 against A. baumannii biofilm formation.(Fig. 4c-g).
The ROS in the bacterial cells was important for the bacteria survival and bacterial resistance.So, in this present research, the accumulation of ROS in A. baumannii after S1032 treatment was further determined with DCFH-DA detection kit.All the results were presented in Fig. 4h, we can see Ofloxacin has no influence on the ROS level in A. baumannii, which also proved the resistance of A. baumannii to Ofloxacin.Similar with Ofloxacin, the S1032 also showed almost no influence on the ROS levels in the bacterial cells.This result suggested that the anti-bacteria effect of S1032 was not mediated by the ROS accumulation in the bacterial cells.and ultimately enhancing the survival rates of infected mice.(Fig. 3c).

Inhibition Effect of the S1032 on A. Baumannii Biofilm Formation
During the infection procession, the A. baumannii has the capacity of the biofilm formation, which could hide themselves, escape antibiotics and finally lead to the biofilmassociated infections on indwelling medical devices (Daele et al. 1987).Thus, the suppression of the S1032 on the A. baumannii biofilm formation was evaluated in this study as well.The 1% crystal violet staining assay indicated that the biofilm of the A. baumannii could be significantly inhibited by the new compound at the sub-MIC with the concentration of 0.25, 0.5 and 1 µg/ml in a dose dependent manner (Fig. 4a-b).Next, the relative expression of the biofilm formation related genes was also determined with q-PCR.The Fig. 3 S1032 increased infected mice survival rate and reduced bacterial load.The A. baumannii was given to induce the infected animal model, followed by the S1032 treatment.The survival of the mice was observed once a day for 7 days since infection (a).The bacterial load of lung tissue was determined with CFU assay (b).The pathological damage of the lung organ was evaluated with H&E staining (c) Fig. 4 S1032 reduced A. baumannii biofilm formation.The A. baumannii were incubated in the plates for the biofilm formation, S1032 was added for treatment at 0.25, 0.5 and 1 µg/ml.The biofilm of the A. baumannii was labeled with 1% crystal violet staining assay (a-b).The relative expression of the biofilm formation related genes (bfmR, bfmS, CsuA, CsuB) were measured with real time RT-CPR assay (c-f).The ROS accumulation in A. baumannii was measured with DCFH-DA detection kit in flow cytometer (g).*P < 0.05, **P < 0.01, and ***P < 0.001 vs. control, n = 5 an important bacterial biofilm formation related protein.
Such results suggested that the S1032 formed a good number of hydrogen bonds with active pocket residues of above proteins, indicating higher intermolecular affinity of the formed complexes.These interactions explained the potential mechanism of the new compound S1032.
In order to further understand the binding interactions, the detailed binding information within the binding pockets between S1032 and four proteins were analyzed.Explicitly, for protein 3TD3, S1032 interacted with residues Arg231, Glu229, Glu267, Phe332 and Thr334 (Fig. 5a), moreover, a perpendicular π-stacking interaction is formed with residue Phe332, and two salt bridges are formed with residues Arg265 and His269, for protein 4JAS, the S1032 interacted with residues Asp10, Ser11, Gln298 and Ala12 (Fig. 5b), and a perpendicular π-stacking interaction is formed with residue His301, for protein 5BUF, multiple active residues were involved in the binding interactions with S1032, including Lys334, Ser335, Ala482, Gln483, Arg508, Asp630, Glu653 and Lys657 (Fig. 5c), in addition, a π-cation interaction and a salt bridge interaction are formed with residue Arg508, and for protein 6FJY, the S1032 was seen to interact with residues Ser117, Arg89 and Tyr49 (Fig. 5d), moreover, a π-cation interaction and two salt bridge interactions are formed with residue Arg89.Moreover, for each binding pose, there were multiple active residues that were in the vicinity of the compound, suggesting potential interaction probabilities.Overall, the results from molecular docking simulations suggest that the S1032 exhibits excellent the capability to interfere with multiplication, growth and biofilm formation of A. baumannii.

S1032 Targeted Several Proteins for the Anti-Bacteria Effect
In the above research, we have revealed that the S1032 has excellent anti-bacteria effect, which could exert protective effect through many different ways, such as influencing the bacterial growth, inhibiting the biofilm formation, and disturbing the bacterial interaction, finally killing the bacteria.However, the detail target of the new compound was still need to be explored.The potential bacterial adaptability and response ability of the S1032 encouraged us to conduct molecular docking simulations, which aimed to identify the potential binding modes and evaluated the interactions between S1032 and target protein structure, by which the underlying mechanism to interfere with multiplication, growth and biofilm formation of A. baumannii can be extracted and rationalized.The docking of S1032 and four protein structures resulted in good, acceptable scores and acceptable binding modes, as displayed in Fig. 5. Intermolecular docked poses with lowest binding affinity energies between S1032 and four receptors (3TD3 (a), 4JAS (b), 5BUF (c) and 6FJY (d)).For each of the docking pose, it can be observed that multiple binding interactions were formed in terms of hydrogen bonding interaction (H-Bond), and their binding affinity energies were − 7.42, -9.15, -7.11 and − 7.97 kcal/mol, respectively.3TD3 stands for the OmpA protein, which an outer membrane protein, response for bacterial biofilm formation, eukaryotic cell infection, antibiotic resistance and immunomodulation (Nie et al. 2020).4JAS stands for BaeSR and AdeSR two-component regulatory systems (TCSs) significantly influence drug resistance (Lingzhi et al. 2018).5BUF stands for AroA, which catalyzes the sixth step of the seven-step shikimate pathway, response for bacterial survival.6FJY stands for CsuE was Ghose, Veber, Egan, and Muegge.Furthermore, it does not have structural features related to PAINS, which may indicate that it is unlikely to cause certain structure-related side effects or adverse reactions.However, it is labeled as a cumarine analog in the Brenk method, which may suggest certain specific biological activities or side effects.
In summary, S1032 exhibits moderate to high lipid solubility and water solubility, and has a high gastrointestinal absorption capacity.In terms of pharmacokinetics, it does not inhibit major CYP enzymes and does not interact with P-gp.From the perspective of drug chemical properties, it has certain drug similarity and potential biological activity.

Derivative Optimization Prediction of S1032 Using Reinforcement Learning Progress
From the above presented experimental and simulation results, the S1032 has been proven exhibiting excellent bioactivity to interfere with multiple proteins and participate in many processes, such as multiplication, growth and biofilm formation of A. baumannii.Thus, the S1032 was used as the training template to investigate possible molecular structures that may have similar or even better bioactivities using the reinforcement learning.As have been mentioned in the above method section, for each of the ligand (S1032) -receptor (3TD3, 4JAS, 5BUF and 6FJY) combination, 20 modifications (actions) are allowed, and up to 10,000 molecule structures are generated and evaluated.The binding affinity energy between the S1032 and the receptor as a function of reinforcement learning steps (optimized structures) are displayed for the four adopted receptors.As one of the indicators for the reinforcement learning progress, a decreasing trend of binding affinity should be observed due to the reinforcement learning nature.In Fig. 7a-d, we can see that all four ligand-receptor combinations exhibit decreasing binding affinity energies with increase in the optimized structures, suggesting a successful reinforcement learning progress from the energetical point of view.Comparing with the training template S1032, for receptor 3TD3, the binding affinity energy is -7.42 kcal/mol, and the

Low Cytotoxicity of S1032
After the pharmacodynamic verification of S1032, its cytotoxicity was then evaluated on HUVEC (Fig. 6a) and 293T (Fig. 6b) cells with CCK-8 detection kit.All the results indicated that the S1032 showed no influence on the viability of the cells, suggesting low cytotoxicity of S1032 during anti-A.baumannii infection therapy.This is an excellent advantage of the new compound compared with most commonly used antibiotics in clinic, which may be explained by the special antibacterial mechanism of S1032.

ADMET Predication of S1032
To study de the pharmacokinetics and toxicity properties of the S1032, ADMET property of this new compound was predicated in this present research.These properties were analyzed via utilizing the swissADME online tool.The ADMET parameters are recorded in Table 5.For S1032 compound, which has moderately soluble property, high GI absorption ability, no CYP inhibition and good druglikeness property.All these results suggested the synthetized compound demonstrated fascinating properties, regarding intestinal adsorption, harmfulness and blood-brain barrier permeability.Therefore, it has the value of further study.
The lipid solubility of S1032 is moderate to high, which is beneficial for its transportation across membranes and its drug action.When it comes to its solubility in water, S1032 shows moderate solubility under different prediction methods.This is important for drug absorption and distribution.The pharmacokinetic properties indicate that S1032 has a high gastrointestinal absorption capacity, but it is unlikely to enter the brain through the BBB (blood-brain barrier).Additionally, it is not a substrate of P-gp, which means it is unlikely to be pumped out of cells by the P-gp transporter.At the same time, it is not an inhibitor of major CYP enzymes, indicating that it is unlikely to cause interactions when used with other drugs.In terms of drug similarity and chemical properties, S1032 meets some pharmacophore models and pharmacokinetic screening criteria, such as Lipinski, energy is -9.15 kcal/mol, and the optimized structures are located within the range from − 5.8 to -12.6 kcal/mol, and 70% of the optimized structures have a relatively lower binding affinity energy (Fig. 7f).For receptor 5BUF, the S1032 exert a binding affinity energy of -7.11 kcal/mol, the optimized structures are ranging from to -5.4 to -11.8 kcal/ mol, and almost all the generated structures (more than 98%) have lower binding affinity energies than S1032 (Fig. 7g).For receptor 6FJY, the original binding affinity energy is -7.97 kcal/mol, the optimized structures are ranging from − 5.3 to -11.2 kcal/mol, and more than 89% of the optimized structures have a binding affinity energy lower than S1032 (Fig. 7h).Though the above results, we draw two conclusions.First, the binding affinity energy for all receptors decreases with increase in the optimized structures.Second, at least more than 40% of the optimized structures have relatively low binding affinity energy than the training template, suggesting that the reinforcement learning progress is successfully implemented from the energetical perspective.

Synthetic Accessibility (SA) Score and Drug-Likeness (QED) Score of New Structures
The synthetic accessibility (SA) score that qualifies how easy a given structure can be synthesized comparing to the known structures in the library serves as another qualification characteristics for the reinforcement learning progress, the results for the four adopted receptors are shown in Fig. 8a.Different from the binding affinity energy, the SA score should have an increased trend as a function of the optimization steps, it can be seen that indeed the profiles for all probed receptors have an increasing trend, and basically the SA scores are ranging from 0.2 to 0.8 (Fig. 8b), suggesting a significant number of optimized structures are expected to be easily synthesized.
The final qualification characteristics is the quantitative estimate of drug-likeness (QED) score, which is used to estimated how likely the optimized structure is similar to known drug molecules in the library, the QED scores for the four probed receptors are presented in Fig. 8c.Similar to the results of SA scores, the QED scores also have an increasing trend as a function of the reinforcement learning steps.It can be seen that basically all the QED score profiles are ranging from 0 to 0.8 (Fig. 8d), combining with the above results for binding affinity energy and SA scores, the above results suggest that all reinforcement learning progresses are succeed in generating effective structures based on the given template S1032.binding affinity energies for receptor 3TD3 are from − 3.6 to -9.7 kcal/mol, and about 41% of the optimized structures have a binding affinity energy that is lower than the S1032 (Fig. 7e).For receptor 4JAS, the original binding affinity in Fig. 9a-d.The binding affinity energies are -9.3,-11.5, -10.9 and -10.4 kcal/mol, where are lower than the training template S1032.Further, the SA scores are 0.68, 0.56, 0.68 and 0.69, and the QED scores are 0.63, 0.55, 0.55, and 0.56, respectively.
Although an energy minimization procedure has been conducted during the reinforcement learning progress for

New Structures Optimized from S1032 by Reinforcement Learning
To further examine the effectiveness of the reinforcement learning, four structures are manually choosing from 10,000 optimized structures for each of the probed receptor (3TD3, 4JAS, 5BUF, and 6FJY), the selected structures are listed

Conclusion
As a multi-drug resistant and invasive pathogen, A. baumannii is one of the major causes of nosocomial infections in the current healthcare system.It is considered as the leading pathogen of pneumonia, sepsis, meningitis, urinary tract and wound infections, and is associated with high mortality rates in clinic (Ayoub Moubareck et al. 2020).A. baumannii has a remarkable ability to acquire or up-regulate various resistance determinants, which making the occurrences of extensively drug-resistant (XDR) and pandrug-resistant (PDR) isolates.Besides, A. baumannii also has the strong ability to form bacterial biofilm to avoid the antibiotic exposure.Now, A. baumannii has been assigned as a critical priority pathogen with great threat to human health by World Health Organization (WHO).Thus, new antibiotics with novel target and antibacterial mechanism are urgently needed, it is also a hot spot in the field of infection disease treatment.each of the optimized structure, however, such an energy minimization proved by the Open Babel serves as an early estimation of the structure on the potential surface.Thus, the four selected structure have been further optimized by the GAFF force field, and 50 binding poses for each of the structure have been estimated again through AutoDock.The intermolecular docked poses with lowest binding affinity energies between the optimized structures with respect to four receptors are displayed in Fig. 9e-h, the corresponding binding affinity energies are -10.56,-10.65, -7.58 and -7.75 kcal/mol, these binding affinity energies are seen to be better or comparable with the training template.
Further, it is observed that for protein 3TD3, the selected structure (Fig. 9e) forms four binding interactions with residues Glu267, Gln314, Arg330 and Thr334, in addition, one parallel π-stacking interaction is formed with residue Phe332.For protein 4JAS, the selected structure (Fig. 9f) is seen to form four hydrogen bonds with residues Thr264, Glu308, Thr442 and Gly441, and a π-cation interaction is formed with residue Arg430.For protein 5BUF, the selected structure (Fig. 9g) has formed seven hydrogen bonds with residues Lys657, Lys334, Arg508, Arg710 and Asp630.And for protein 6FJY, there are two binding interactions are formed between the selected structure (Fig. 9h) and residues Ser226 and Gln231, and a perpendicular π-stacking interaction is formed with residue Tyr9.The above results Fig. 9 Selected structures that are choosing from 10,000 optimized structures for each of the probed protein (a-d).Intermolecular docked poses with lowest binding affinity energies between the optimized structures with respect to four proteins 3TD3 (e), 4JAS (f), 5BUF (g) and 6FJY (h).The labels for contacting residues and the lengths for binding interactions are listed explicitly that the reinforcement learning progress we developed is a powerful tool for designing and optimizing novel drug molecules based on a given template.However, the biological activities of these compounds still need to be evaluated in the further research.
In summary, this is a profoundly significant study.Targeting the difficult-to-treat pathogen A. baumannii, this study offers us a new perspective for designing novel antiinfective drugs.By synthesizing coumarin derivatives with anti-A.baumannii activity and screening them, we can evaluate their biological effects both in vitro and in vivo.This research approach not only helps us understand the mechanism of these compounds, but also aids in a better comprehension of the mechanism of resistance of A. baumannii.
Moreover, exploring the action mechanisms and potential targets of these novel compounds can provide valuable information for future drug design and optimization.This not only facilitates the development of more effective anti-infective drugs, but also helps us better understand the life processes of the pathogen, thus offering new insights for future treatment strategies.Overall, this study provides valuable theoretical and experimental data for the development of anti-infective drugs and offers new hope for solving the global problem of A. baumannii infections.
Recently, the coumarins exhibit a plethora of biological activities, such as anti-inflammatory and anti-tumor effect.In 2016, Jyoti Dandriyal has revealed that the C-4 substituted coumarin derivatives showed excellent anti-cancer activity (Abdelaziz et al. 2022).The Yang Hu revealed the also showed coumarin derivatives were considered as a promising lead compound for the development of commercial drugs (Hu et al. 2019).In this present research, the coumarin derivatives (1-5) and derivatives (6-10) were synthesized, and their application values on the A. baumannii infection was evaluated in vivo and in vitro.The results of the MIC values and the A. baumannii growth curves suggested the coumarin derivatives have much stronger anti-bacterial activity than the dihydropyran derivatives.While, among the coumarin derivatives, compound 1 (S1032) exhibited the strongest biological activity.Even though the compound 2 has similar structure with the S1032, but its anti-bacterial activity was much weaker than the S1032.According to this, we speculate that the substituent of the S1032 could increase the polarity of the compound, which then increase the concentration of the compound in the plasma.Besides, the crystal structure of S1032 made it bind with the target more stronger than the compound 2. The S1032 was then used for anti-A.baumannii infection evaluation in vivo.After treated with the S1032 with the concentration of 1, 2, 5 mg/kg, the survival rate of A. baumannii infected mice and bacterial load in the lung tissue was also reduced in a dose dependent manner.For the bacterial biofilm formation, the S1032 could also reduce the bacterial biofilm formation and the related gene expression in a dose dependent manner.All the data in this this research showed that the S1032 may be an excellent candidate for the A. baumannii infection treatment through inhibiting the bacterial biofilm formation and inducing the ROS production.

Fig. 5
Fig. 5 Intermolecular docked poses with lowest binding affinity energies between S1032 and four proteins (3TD3 (a), 4JAS (b), 5BUF (c) and 6FJY (d).The labels for contacting residues and the lengths for binding interactions are listed explicitly.The binding interactions are analyzed by PLIP (Adasme et al. 2021)

Fig. 6
Fig. 6 S1032 exhibited low cytotoxicity on normal human cells.The S1032 compound was incubated with HUVEC (a) and 293T cells (b), CCK-8 detection kit was used to measure the Cell survival rate of cells

Table 2
Sequences of primers used in this research PrimersSequences reinforcement learning approach that was implemented and performed in the current study is based on the widely used molecule deep Q-networks (MolDQN)(Zhou et al.  2019).During the reinforcement learning process, a known molecule that has been proved to have excellent bioactivities depending on demands and requirements of the study (in the current work, the desired molecule is the inhibitor of A. baumannii) is used as the training template.Then, multiple actions are allowed to modify the template and generate novel structure which is expected to have similar or even better bioactivity than the given template, the allowed actions are atom addition, bond addition, bond removal and un-modification.After a certain number of actions has been performed.Three qualification characteristics are deter- mined upon the optimized structure, these qualification characteristics are: (i).binding affinity energy between the optimized molecule and the protein receptor; (ii).synthetic accessibility (SA) score; (iii) quantitative estimate of druglikeness (QED) score.Explicitly, the binding affinity energy is evaluated by QuickVina 2, which has been proven to have both accuracy and efficiency as AutoDock 4, as has been mentioned in the above docking study, the gym-molecule library has been employed to calculate the SA score, and the open source library rdkit (https://www.rdkit.org/)has been utilized to estimate the QED score.

Table 4
MIC values of S1032 on clinical A. baumannii strains Fig. 2 Inhibitory activity of S1032 against A. baumannii growth in vitro.Growth curve of A. baumannii ZB 25,321 after S1032 treatment (a).Growth curve of A. baumannii ZB 25,322 after S1032 treatment (b) Compounds MRSA N315 S. aureus 29,213 P. aeruginosa K. pneumoniae A. baumannii E.

Table 3
MIC values of new compounds on bacteria

Table 5
Pharmacokinetics and toxicity properties of the S1032